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Abstract 


Functions  that  map  boolean  vectors  into  the  integers  are  important  for  the  design  and 
verification  of  arithmetic  circuits.  MTBDDs  and  BMDs  have  been  proposed  for  representing 
this  class  of  functions.  We  discuss  the  relationship  between  these  methods  and  describe  a 
generalization  called  hybrid  decision  diagrams  which  is  often  much  more  concise. 

The  Walsh  transform  and  Reed-Muller  transform  have  numerous  applications  in  computer- 
aided  design,  but  the  usefulness  of  these  techniques  in  practice  has  been  limited  by  the 
size  of  the  boolean  functions  that  can  be  transformed.  Currently  available  techniques  limit 
the  functions  to  less  than  20  variables.  In  this  paper,  we  show  how  to  compute  concise 
representations  of  the  Walsh  transform  and  Reed-Muller  transform  for  functions  with  several 
hundred  variables. 

We  show  how  to  implement  arithemetic  operations  efficiently  for  hybrid  decision  diagrams.  In 
practice,  this  is  one  of  the  main  limitations  of  BMDs  since  performing  arithmetic  operations 
on  functions  expressed  in  this  notation  can  be  very  expensive. 

In  order  to  extend  symbolic  model  checking  algorithms  to  handle  arithmetic  properties,  it 
is  essential  to  be  able  to  compute  the  BDD  for  the  set  of  variable  assignments  that  satisfy 
an  arithmetic  relation.  Bryant  and  Chen  do  not  provide  an  algorithm  for  this. 

In  our  paper,  we  give  an  efficient  algorithm  for  this  purpose.  Moreover,  we  prove  that 
for  the  class  of  linear  expressions,  the  time  complexity  of  our  algorithm  is  linear  in  the 
number  of  variables.  Our  techniques  for  handling  arithmetic  operations  and  relations  are 
used  intensively  in  the  verification  of  an  SRT  division  algorithm  similar  to  the  one  that  is 
used  in  the  Pentium. 


1.  Introduction 


Large  integer  matrices  arise  naturally  in  the  design  and  verification  of  arithmetic  circuits. 
In  this  paper,  we  describe  how  to  represent  and  manipulate  such  matrices  efficiently  using 
Multi- Terminal  Binary  Decision  Diagrams  (MTBDDs)  [6].  An  MTBDD  is  like  an  ordinary 
Binary  Decision  Diagram  except  that  the  terminal  nodes  can  be  arbitrary  integer  values 
instead  of  just  0  and  1.  Previously,  we  have  demonstrated  how  MTBDDs  can  be  used 
to  represent  functions  that  map  boolean  vectors  into  the  integers.  Our  representation  for 
integer  matrices  is  based  on  this  technique.  An  integer  matrix  with  dimensions  2"^  x  2"  can 
be  treated  as  a  function  that  maps  boolean  vectors  of  length  m  +  n  into  the  integers.  Various 
matrix  operations  can  be  performed  by  operations  on  the  corresponding  integer  functions. 

The  Walsh  transform  and  the  Reed-Muller  transform  [9]  have  numerous  applications 
in  computer  aided  design,  particularly  in  synthesis  and  testing  of  circuits.  Unfortunately, 
the  usefulness  of  these  techniques  in  practice  has  been  limited  by  the  size  of  the  boolean 
functions  that  can  be  handled  by  the  transform.  Since  these  transforms  are  given  as  vectors 
with  length  of  2"  where  n  is  the  number  of  variables  in  the  function,  currently  available 
techniques  limit  the  functions  to  less  than  20  variables.  Since  the  Walsh  matrix  and  the 
Reed-Muller  matrix  have  simple  recursive  definitions,  they  can  be  encoded  efficiently  by 
MTBDDs.  In  this  manner,  we  can  compute  concise  representations  for  the  transforms  of 
functions  with  several  hundred  variables. 

Recently,  Bryant  and  Chen  [4]  have  proposed  Binary  Moment  Diagrams  (BMDs)  for 
representing  functions  that  map  boolean  vectors  into  the  integers.  We  show  that  the  BMD  of 
a  function  is  the  MTBDD  that  results  from  applying  the  inverse  Reed-Muller  transformation 
[10]  to  the  function.  The  transformation  can  be  computed  using  the  techniques  that  we  have 
developed  for  manipulating  large  matrices.  The  transformation  matrix  in  this  case  is  the 
Kronecker  product  [2]  of  a  number  of  identical  2x2  matrices.  We  show  that  the  Kronecker 
products  of  other  2x2  matrices  behave  in  a  similar  way.  In  fact,  the  transformations 
obtained  from  Kronecker  products  of  other  matrices  will  in  many  cases  be  more  concise  than 
the  BMD.  We  have  further  generalized  this  idea  so  that  the  transformation  matrix  can  be 
the  Kronecker  product  of  different  matrices.  In  this  way,  we  obtain  a  representation,  called 
Hybrid  Decision  Diagram  (HDD),  that  is  more  concise  than  either  the  MTBDD  or  the  BMD. 

One  of  the  main  limitations  of  Bryant  and  Chen’s  work  is  that  performing  arithmetic  op¬ 
erations  on  functions  represented  by  BMDs  is  very  expensive.  We  show  how  these  operations 
can  be  implemented  not  only  for  BMDs,  but  for  hybrid  decision  diagrams  as  well.  Although 
the  worst  case  complexity  of  some  of  these  operations  is  exponential,  our  algorithms  work 
quite  well  in  practice. 

Most  of  the  properties  that  we  want  to  verify  about  arithmetic  circuits  can  be  expressed 
as  arithmetic  relations.  In  order  to  extend  symbolic  model  checking  algorithms  [5]  to  handle 
arithmetic  properties,  it  is  essential  to  be  able  to  compute  the  BDD  for  the  set  of  variable 
assignments  that  satisfy  a  relation.  Bryant  and  Chen  do  not  provide  an  algorithm  for  this. 
In  this  paper,  we  give  an  efficient  algorithm  for  this  purpose.  Moreover,  we  show  that 
for  the  class  of  linear  expressions,  the  time  complexity  of  our  algorithm  is  linear  in  the 
number  of  variables.  Our  techniques  for  handling  arithmetic  operations  and  relations  are 
used  intensively  in  the  verification  of  an  SRT  division  algorithm  similar  to  the  one  that  is 
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used  in  the  Pentium. 

Our  paper  is  organized  as  follows:  Section  2  gives  the  basic  properties  of  MTBDDs 
that  are  used  in  the  remainder  of  the  paper.  Section  3  shows  how  the  results  of  the  previous 
section  can  be  used  to  implement  standard  operations  like  addition  and  multiplication  of  very 
large  integer  matrices.  Section  4  describes  how  HDDs  can  be  obtained  for  recursively  defined 
integer  matrices  and  shows  how  to  compute  the  spectral  transforms  for  boolean  functions.  In 
Section  4  we  also  illustrate  the  power  of  this  representation,  by  computing  the  transforms  of 
several  very  large  boolean  functions.  Section  5  describes  the  relationship  between  BMDs  and 
the  inverse  Reed-Muller  transformation.  This  section  also  introduces  Kronecker  product  and 
shows  how  it  can  be  used  to  generalize  BMDs.  The  next  section  introduces  hybrid  decision 
diagrams  and  provides  experimental  evidence  to  show  the  usefulness  of  this  representation. 
In  Section  7,  we  show  how  arithmetic  operations  can  be  implemented.  In  Section  8,  we 
give  an  efficient  algorithm  for  computing  the  set  of  assignments  that  satisfy  an  arithmetic 
relation  expressed  in  terms  of  hybrid  decision  diagrams.  The  paper  concludes  in  Section  9 
with  a  brief  summary  and  a  discussion  of  directions  for  future  research. 


2.  Multi-terminal  binary  decision  diagrams 

Ordered  binary  decision  diagrams  (BDDs)  are  a  canonical  representation  for  boolean  for¬ 
mulas  proposed  by  Bryant  [3].  They  are  often  substantially  more  compact  than  traditional 
normal  forms  such  as  conjunctive  normal  form  and  disjunctive  normal  form.  They  can  also 
be  manipulated  very  efficiently.  Hence,  BDDs  have  become  widely  used  for  a  variety  of 
CAD  applications,'  including  symbolic  simulation,  verification  of  combinational  logic  and, 
more  recently,  verification  of  sequential  circuits. 

A  BDD  is  similar  to  a  binary  decision  tree,  except  that  its  structure  is  a  directed  acyclic 
graph  rather  than  a  tree,  and  there  is  a  strict  total  order  placed  on  the  occurrence  of 
variables  as  one  traverses  the  graph  from  root  to  leaf.  Algorithms  of  linear  complexity  exist 
for  computing  BDD  representations  of  -■/  and  fWg  from  the  BDDs  for  the  formulas  /  and  g. 

Let  /  :  — »■  Z  be  a  function  that  maps  boolean  vectors  of  length  m  into  integers. 

Suppose  ni, . . .  ,njv  are  the  possible  values  of  /.  The  function  /  partitions  the  space  B™‘ 
of  boolean  vectors  into  N  sets  {^i,  •  •  • ,  S'at},  such  that  S'i  =  {«  |  f{x)  =  Ui}.  Let  fi  be 
the  characteristic  function  of  Si,  we  say  that  /  is  in  normal  form  if  f{x)  is  represented  as 
fi{^)  •  This  sum  can  be  represented  as  a  BDD  with  integers  as  its  terminal  nodes. 
We  call  such  DAGs  Multi- Terminal  BDDs  (MTBDDs)  [1,  6]. 

Any  arithmetic  operation  0  on  MTBDDs  can  be  performed  in  the  following  way. 

h{x)  =  f{x)Qg{x) 

N  N’ 

=  n'- 

i=l  i=l 

i-1  j=l 


2 


=  V  fi{^)9j{x)n'l 

k=l  niQn''=n’l 


fiQ  g  f2  Q  9  f  Q  9i  f  Q  92  fi  Q  9i  /2  ©  S'2 

Xi  Xj  Xi  Xj  Xi  Xj 

Figure  2:  BDD  of  f  Q  g 

We  now  give  an  efficient  algorithm  for  computing  f{x)  Q  g{x). 

•  If  /  is  a  leaf,  then  for  each  leaf  of  g,  apply  0  with  /  as  the  first  argument. 

•  If  (jf  is  a  leaf,  then  for  each  leaf  of  /,  apply  O  with  g  as  the  second  argument. 

•  Otherwise,  /  and  g  have  the  form  in  Figure  1,  and  the  BDD  for  /  ©  ^f,  depending  on 
the  relative  order  of  Xi  and  Xj^  is  given  in  Figure  2. 

The  resulting  diagram  may  not  be  in  normal  form.  In  order  to  convert  it  into  normal  form, 
a  reduction  phase  is  needed.  The  algorithm  for  this  phase  is  essentially  identical  to  the 
reduction  phase  in  Bryant’s  algorithm  for  constructing  BDDs  [3]  . 

Functions  that  map  boolean  vectors  into  the  integers  can  also  be  represented  as  arrays 
of  BDDs.  These  BDDs  have  boolean  values  and  each  corresponds  to  one  bit  of  the  binary 
representation  of  the  function  value.  In  general,  it  is  quite  expensive  to  perform  operations 
using  this  representation. 
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3.  Matrix  Operations 

Let  M  be  a  2^  X  2^  matrix  over  TV.  It  is  easy  to  see  that  M  can  be  represented  as  a 
function  M  :  TV,  such  that  Mij  =  M{x,y),  where  x  is  the  bit  vector  for  i  and  y  is 

the  bit  vector  for  j.  Therefore,  matrices  with  integer  values  can  be  represented  as  integer 
valued  functions  using  the  MTBDD  representation  in  Section  2.  We  need  the  following 
operations  for  integer  matrices  for  computing  the  spectral  transforms:  absolute  value,  scalar 
multiplication,  addition,  sorting  a  vector  of  integers,  summation  over  one  dimension,  and 
matrix  multiplication.  The  first  three  operations  are  trivial  and  will  not  be  discussed  in  this 
paper. 

•  Summing  matrices  over  one  dimension 

It  is  sometimes  desirable  to  obtain  a  2”  vector  from  a  2”  x  2™  matrix  that  each  element 
in  the  vector  is  the  summation  of  the  corresponding  column,  i.e.  M'-  —  Mij. 

When  the  matrices  are  expressed  in  terms  of  integer  valued  functions,  the  equation 
becomes  M'{x)  =  J2yM{x,y),  where  Xiy  means  “sum  over  all  possible  assignments  to 
•y”.  In  practice,  Y.yM{x,y)  can  be  computed  as: 

Yf,  M{x,yi,y2,...,ym) 

yi  2/2 —3/m 

=  Y,  YM{x,yi,y2,...,ym) 

yi3/2--3/m-l  3/m 

—  'y  \  (Tl:f (3:,  j/i,  2/2;  •  •  • )  J/m— 1 7  H)  T  T\T(a:,  yi ,  y2?  •  •  •  5  J/m— 1 5 1)) 

In  this  way,  each  variable  in  y  is  eliminated  by  performing  an  addition. 

This  operation  can  also  be  used  to  sum  the  elements  of  a  vector  and  to  obtain  a  two 
dimensional  matrix  from  a  three  dimensional  matrix  by  summing  over  one  dimension. 
Although  this  operation  works  well  in  many  cases,  the  worst  case  complexity  can  be 
exponential  in  the  number  of  variables. 

•  Sorting  vectors 

Frequently,  it  is  useful  to  rearrange  the  elements  in  a  vector  so  that  they  are  in  non¬ 
decreasing  order.  When  the  number  of  different  values  in  the  vector  is  not  very  large, 
the  sorted  vector  can  be  represented  concisely  without  using  MTBDDs.  In  order  to 
uniquely  determine  a  sorted  vector,  we  only  need  to  know  the  set  of  different  values  and 
the  number  of  occurrences  of  each  value.  Thus,  the  sorted  vector  can  be  represented 
as  a  list  with  length  m,  where  m  is  the  number  of  different  values.  Each  element  in 
the  list  contains  the  value  and  number  of  its  occurrences. 

It  is  easy  to  find  the  set  of  different  values,  since  it  is  only  necessary  to  collect  all  of 
the  terminal  nodes  in  the  MTBDD.  The  number  of  occurrences  Nk  of  a  possible  value 
Ck  can  be  calculated  as  Nk  =  Mi  =  Ck  then  1  else  0).  The  operation  of 

summation  over  a  vector  discussed  previously  can  be  applied  to  compute  this  sum. 
Although,  in  general,  the  complexity  of  the  summation  operation  does  not  have  a 
satisfactory  upper  bound,  summation  over  a  vector  takes  time  linear  in  the  size  of 
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the  MTBDD  representing  the  vector.  Thus  the  complexity  of  the  sorting  operation  is 
linear  in  both  the  number  of  distinct  values  in  the  vector  and  the  size  of  the  MTBDD 
representation  of  the  vector. 

•  Matrix  multiplication 

Suppose  that  two  matrices  A  and  B  have  dimensions  2^  x  2^  and  2‘  x  2”,  respectively. 
Let  C  =  A  X  B  he  the  product  of  A  and  B,  C  will  have  dimension  2^  x  2”^.  If  we  treat 
A  and  B  as  integer  valued  functions,  we  can  compute  the  product  matrix  C  as 

C{x,z)  =  '^A{x,y)B{y,z) 
y 

using  the  summation  operation  discussed  above.  In  general,  the  complexity  of  this 
operation  can  also  be  exponential  in  the  number  of  variables. 


4.  Spectral  transformations  of  boolean  functions 


Two  of  the  most  commonly  used  transformations  in  digital  circuit  design  are  the  Walsh 
transform  and  the  Reed-Muller  transform  [9].  In  this  section,  we  will  show  how  the  MTBDD 
based  techniques  described  previously  can  be  used  to  compute  concise  representations  of  the 
spectra  for  these  transformations. 

The  Walsh  matrix  Tn  has  the  recursive  definition: 


ro  =  i 


Tn  = 


Tn-1  Tn-l 
Tn-1  —Tn-1 


Each  element  of  the  matrix  is  determined  by  its  row  and  column  coordinates.  We  will  encode 
the  2”  columns  by  variables  . . . ,  t/i  and  the  2"  rows  by  the  variables  a;„, . . . ,  xi.  Tn  can 
be  represented  as  an  integer  valued  function: 


Tn{y  •  *  *  ?  J/l  ?  ?  a:i) 


f  Tn— l(j/n— 1?  •  •  •  iHli  Xn—li  •  •  •  5  ®l)  if  {Xnyn  ^  1) 

Tn—l{})n—l  1  •  •  •  iVli  Xn—1 ;  •  •  •  5  if  {Xnyn  1) 

T„_i(y„_i,. ..  ,yi,a;„_i,...,a;i)  •  (if  =  1  then  -1  else  1) 


The  above  recursive  definition  can  be  expressed  by  an  MTBDD  as  shown  in  Figure  3. 


Figure  3:  MTBDD  for  T„ 


The  Walsh  transform  maps  a  boolean  vector  /  with  length  2"  to  an  integer  vector  of 
length  2",  denoted  by  W/,  in  which  each  component  is  between  —2”  to  2”.  The  transform 
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can  be  easily  expressed  using  the  Walsh  matrix,  Wf  =  Tn  x  (1  —  2f)  [9].  For  example,  the 
vector  [0, 1, 1, 1, 1,0,0, 0]^  is  mapped  into  [0, 0, 0,0,  —4,4, 4,4]  . 

Likewise,  the  Reed-Muller  matrix  has  the  recursive  definition: 


5o  =  l 


T  = 

n  — 


5.-1 


0 

5„-i 


which  can  be  expressed  by 


Sn{y  n?  •  •  •  5  J/l?  •  •  •  >  ®l) 


I  5„-i(y„_i,...,yi,x„_i,...,a;i)  if  •  y„  =  0 

I  0  if  •  yn  =  1 

if  ((->Xn)-j/n)  then  0  else  5'„_i(y„_i, . . .  ,yi,a:„_i, . . .  ,a;i) 


and  has  the  MTBDD  representation  in  Figure  4. 


Figure  4:  MTBDD  for 

The  Reed-Muller  transformation  maps  a  boolean  vector  of  length  2”  into  another  boolean 
vector  of  the  same  length.  This  transformation  can  be  expressed  by  the  matrix  multiplication 
Rf  =  S„  X  f .  However,  during  the  matrix  mutiplication,  integer  addition  is  replaced  by  XOR 
in  order  to  perform  the  modulo  2  arithmatic.  For  example,  the  vector  [0, 1, 1, 1, 1, 0, 0, 0]  is 
mapped  into  [0, 1, 1, 1, 1, 0, 0, 0]^. 

When  the  number  of  variables  is  large,  the  transformations  can  be  computed  by  repre¬ 
senting  the  matrices  and  the  vectors  as  MTBDDs  and  matrix  operations  can  be  performed 
as  described  in  Section  3  and  Section  4. 

To  illustrate  the  power  of  these  techniques,  we  have  computed  the  Walsh  transformation 
and  Reed-Muller  transformation  for  some  large  combinatorial  circuits,  including  two  adders 
and  some  of  the  ISC  AS  benchmarks  (Table  1).  The  examples  were  run  on  a  DEC-5000  and 
run  time  is  shown  in  seconds. 


5.  Kronecker  transformations 

Recently,  Bryant  and  Chen  [4]  have  developed  a  new  representation  for  functions  that  map 
boolean  vectors  to  integer  values.  This  representation  is  called  the  Binary  Moment  Diagram 
(BMD)  of  the  function.  Instead  of  the  Shannon  expansion  /  =  xfi  +  (1  —  x)fo,  they  use 
the  expansion  f  =  fo  +  xf,  where  /'  is  equal  to  /i  —  /q.  After  merging  the  common 
subexpressions,  a  DAG  representation  for  the  function  is  obtained.  They  prove  in  their 
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example  circuit 

Walsh  coef. 

R-M  coef. 

circuit 

1  input  1 

output 

^  of  gates 

|BDD| 

|MTBDD| 

time 

|MTBDD| 

time 

cl908 

33 

9 

880 

3607 

1850 

44 

27748 

184 

50 

mm 

1669 

520 

15985 

171 

4679 

8.2 

c5315 

813 

2307 

1397 

7069 

328 

2647 

25 

50-bit  adder 

C'so 

250 

151 

7456 

23 

249 

2.3 

100-bit  adder 

200 

ClOO 

500 

301 

29906 

128 

499 

11 

Table  1:  Experimental  results  for  spectral  transformations 


Figure  5:  MTBDD  for 

paper  that  this  gives  a  compact  representation  for  certain  functions  which  have  exponential 
size  if  represented  by  MTBDDs  directly. 

There  is  a  close  relationship  between  this  representation  and  the  inverse  Reed-Muller 
transformation  [10].  The  matrix  for  the  inverse  Reed-Muller  transformation  is  defined  re¬ 
cursively  by 

0  \ 

Sn—l  Sn—l  I 


Ro  =  1  Sn^ 


which  has  a  linear  MTBDD  representation  as  shown  in  Figure  5.  Let  i  G  5"  be  the  binary 
representation  of  the  integer  0  <  i  <  2”.  A  function  f  :  B'^  N  can  be  represented  as  a 
column  vector  where  the  value  of  the  i-th  entry  is  f{i).  We  will  not  distinguish  between  a 
function  and  its  corresponding  column  vector.  The  inverse  Reed-Muller  transformation  can 
be  obtained  by  multiplying  the  transformation  matrix  and  the  column  vector  f  =  S  x  f 
using  the  technique  described  in  previous  section. 


Theorem  1  The  MTBDD  of  f  is  isomorphic  to  the  BMD  of  f. 
The  Kronecker  product  of  two  matrices  is  defined  as  follows: 


(an  . . 

^  aiiB  . . 

. .  aimB  ^ 

A®B  = 

; 

®B  = 

: 

flnl  • 

•  •  ^nm  / 

ttnlB  .  . 

’  *  ^nmB  j 
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The  inverse  Reed-Muller  matrix  can  be  represented  as  the  Kronecker  product  of  n  identical 
2x2  matrices: 


5'„  = 


5„_i  0 

—  Sn-l  Sn-l 


Sn-1  = 


n 


The  inverse  Reed-Muller  transformation  is  not  unique  in  this  respect.  Other  transfor¬ 
mations  that  are  defined  as  Kronecker  products  of  2  x  2  matrices  may  also  provide  concise 
representations  for  functions  mapping  boolean  vectors  into  integers.  In  particular,  Reed- 
Muller  matrix  and  Walsh  matrix  can  be  represented  as  Kronecker  products  shown 
below: 


f  Rn-i  0 
y  Rn—1  Rn—1 


1  0 
1  1 


®  Rn—1 


and 


Wn  = 


Wn-1 

-W„_1 


1  1 

1  -1 


®  Wn-1  = 


1 

1  - 


1 

-1 


Although  a  Kronecker  transformation  can  be  performed  by  matrix  multiplication,  there 
is  a  more  efficient  way  of  computing  it.  It  is  a  well  known  property  of  the  Kronecker  product 
that 

k  k 

A,-  =  ®  Ai  ®  J2fc-i), 

i=0  i=0 

where  each  Aj-  is  a  2  x  2  matrix  and  Ik  is  the  identity  matrix  of  size  k  x  k.  A  transformation 

of  the  form  (/2*-i  ®  A,-  ®  R^-i)  is  called  a  basic  transformation.  Let  Aj  =  (  ), 

\  «io  «ii  / 

and  let  be  a  function  represented  as  a  MTBDD,  then  the  basic  transformation  g'  = 
(/2«-l  ®  A,  (S)  X  g  can  be  computed  as 


g'  =  if  Xi  then  ooo  g\xi=a  +  «oi  g\xi=i  else  Uio  g\xi=(i  +  oii  g\xi=i- 


As  a  result  of  this  observation,  the  Kronecker  transformation  can  be  performed  by  a  series  of 
basic  transformations.  Moreover,  it  can  be  proved  that  the  order  of  the  basic  transformations 
does  not  effect  the  final  result. 

In  fact,  the  Kronecker  product  of  any  non-singular  2x2  matrices  can  be  used  as  a 
transformation  matrix  and  will  produce  a  canonical  representation  for  the  function.  If  the 
entries  of  the  2x2  matrix  are  restricted  among  {0, 1,  —1},  there  are  six  interesting  matrices 


1  0 
0  1 


1  0 

-1  1 


1  0  W  0  1 

1  1  )^\-l  1 


0  1 
1  1 


and 


All  other  matrices  are  either  singular  or  would  produce  BDDs  that  are  isomorphic  to  one  of 
the  six  matrices. 
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We  have  applied  these  transformations  to  the  functions  discussed  in  paper  [4].  The  trans¬ 
formation  can  be  partitioned  into  two  groups  of  three  each.  The  MTBDDs  of  the  results 
after  applying  the  transformations  in  the  same  group  have  the  same  complexity. 

Let  X  =  ELo =  Er=o =  EZo then 


base  matrix 

X 

XY 

Xk 

Airr 

0(2”) 

0(2^”) 

0(2”+™) 

0(2*=”) 

o(n,io2"0 

1 

IH 

■ 

0(n) 

0(n2) 

0{nm) 

0(n'') 

O(n‘=on,) 

The  possibility  of  using  BMDs  to  represent  boolean  functions  is  discussed  in  [4].  In  gen¬ 
eral,  the  BMD  does  not  appear  to  be  better  than  the  ordinary  BDD  for  representing  boolean 
functions.  In  order  to  see  why  this  is  true,  consider  the  boolean  Reed-Muller  transformation, 
which  is  sometimes  called  the  Functional  Decision  Diagram  or  FDD  [8].  This  transformation 
can  be  obtained  by  applying  the  modulo  2  operations  to  all  of  the  terminal  nodes  of  the 
BMD.  Consequently,  the  size  of  FDD  is  always  smaller  than  the  size  of  the  BMD.  Since  the 
inverse  boolean  Reed-Muller  transformation  is  the  same  as  the  boolean  Reed-Muller  trans¬ 
formation,  the  FDD  of  the  FDD  is  the  original  BDD.  Therefore,  for  every  function  /  such 
that  |FDD/|  <  |BDD/|,  there  exists  another  function  /'  which  is  the  boolean  Reed-Muller 
transform  of  /  such  that  |BDD/'|  <  |FDD/>|.  In  particular,  both  the  BMD  and  the  FDD 
representations  for  the  middle  bit  of  a  multiplier  are  still  exponential. 


6.  Hybrid  decision  diagrams 

In  the  previous  sections,  we  have  discussed  transformations  that  can  be  represented  as  the 
Kronecker  product  of  a  number  of  identical  2x2  matrices.  If  the  transformation  matrix  is 
a  Kronecker  product  of  different  2x2  matrices,  we  still  have  a  canonical  representation  of 
the  function.  We  call  transformations  obtained  from  such  matrices  hybrid  transformations. 

A  similar  strategy  has  been  tried  by  Becker  [7].  However,  his  technique  only  works  for  the 
boolean  domain.  When  using  his  technique,  all  of  the  transformation  matrices,  the  original 
function  and  the  resulting  function  must  have  boolean  values.  Our  technique,  on  the  other 
hand,  works  over  the  integers.  By  allowing  integer  values,  we  can  handle  a  wider  range  of 
functions.  Moreover,  we  can  obtain  larger  reduction  factors  since  we  have  more  choices  for 
transformation  matrices. 

We  can  apply  this  idea  to  reduce  the  size  of  MTBDD  representation  of  functions.  Since 
there  is  no  known  polynomial  algorithm  to  find  the  hybrid  Kronecker  transformation  that 
minimizes  MTBDD  size,  we  use  a  greedy  algorithm  to  reduce  the  size.  If  we  restrict  the 
entries  in  the  matrix  to  the  set  {0, 1,  —1},  then  there  are  six  matrices  we  can  try.  For  each 
variable,  we  select  the  matrix  that  gives  the  smallest  MTBDD  size.  The  MTBDDs  obtained 
from  such  transformations  are  called  Hybrid  Decision  Diagrams  (HDDs).  We  have  tried  this 
method  on  the  ISCAS85  benchmark  circuits.  In  some  cases  we  have  been  able  to  reduce 
the  size  of  BDD  representation  by  a  factor  of  1300.  However,  reductions  of  this  magnitute 
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usually  occur  when  the  original  function  has  a  bad  variable  ordering.  If  dynamic  variable 
ordering  is  used,  then  our  method  gives  a  much  smaller  reduction  factor. 


example  circuit 

without  reordering 

with  reordering 

circuit 

|input 

output 

BDD| 

BMD 

|HDD| 

BDD 

BMD 

HDD 

cl355 

41 

1327 

9419 

1217689 

2857 

4407 

478903 

1518 

cl908 

33 

12 

3703 

140174 

1374 

1581 

154488 

632 

c5315 

178 

676 

679593 

2820 

521 

108 

5106 

107 

Table  2:  Experimental  results  for  hybrid  transformations  of  some  ISCAS85  circuits 


We  have  tried  several  techniques  to  increase  the  number  of  possible  matrices.  The  first 
technique  involves  increasing  the  number  of  entries  in  the  matrices.  This  can  be  accom¬ 
plished  by  allowing  the  entries  to  take  larger  values  or  by  using  the  complex  numbers 
{0, 1,  — 1, — z,  1  -f  i,  1  —  i^i  —  1,— i  —  1}.  Unfortunately,  neither  extension  improved  the 
results  significantly. 

The  second  technique  involves  using  transformation  matrices  that  are  Kronecker  products 
of  larger  matrices.  For  example,  we  have  tried  hybrid  Kronecker  transformations  based  on 
4x4  matrices  instead  of  2  x  2  matrices.  Although  we  have  been  able  to  reduce  the  BDD 
size  even  further  using  this  technique,  the  time  it  takes  to  find  such  transformations  is  much 
bigger  since  the  number  of  possibilities  is  considerably  larger. 

Note  that  our  technique  can  achieve  comparable  and  sometimes  better  results  than  dy¬ 
namic  variable  reordering.  Thus,  in  some  cases,  it  can  serve  as  an  alternative  to  dynamic 
variable  reordering.  We  conjecture  that  the  combination  of  both  techniques  together  may 
result  in  reductions  that  neither  technique  can  achieve  alone. 

7.  Arithmetic  operations  on  hybrid  decision  diagrams 

In  order  to  make  the  techniques  described  in  the  previous  sections  more  useful,  it  is  desirable 
to  be  able  to  perform  various  arithmetric  operations  on  on  hybrid  BDDs.  In  this  paper,  we 
only  consider  the  cases  of  addition  and  multiplication  of  two  integers. 

Suppose  that  /  is  transformed  into  /'  by  the  matrix  Ti  and  g  is  transformed  into  g'  by 
the  matrix  T2  using  the  techniques  discussed  in  the  previous  sections.  Scalar  multiplication 
is  simple  to  perform. 

(cf)'  =  Tx  X  (cf)  =  cTi  X  /  =  cf 
When  Ti  —  T2,  finding  the  sum  of  two  function  is  also  simple. 

{f  +  9y  =  nx{f  +  g)  =  T^xf  +  T,xg  =  f  +  g' 

If  Ti  ^  T2,  the  transformation  applied  to  the  sum  must  be  determined  first.  Suppose  we  use 
T2  as  the  transformation  matrix  for  the  result, 

if  +  9)'  =  T2  X  {f  +  g)  =  T2  X  f  i-  T2  X  g  =  T2  X  Ti  ^  X  f  +  g' . 
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Next,  we  consider  how  to  perform  multiplication.  We  choose  T2  as  the  transformation 
matrix  for  {f  ■  g)-  Suppose  the  top  level  variable  is  Xi.  Assume  the  top  level  transform  for 


with  inverse 


with  inverse 


Assume  also  the  top  level  transform  for  g  is 


Then  To  = 


82  = 


^1282 
622  <5*2 


f  g' 


Figure  6:  BDDs  for  f  and  g' 


Figure  7:  BDD  of  (/  •  g)' 


if-g)'  =  T^xif-g) 

_  (  i\\82  ^1282  \  ^  f  fo '  go  \ 
-  [  b2l82  h2282  j  \h-gx  j 

_  /  bii{fo  ■  go)' +  bi2{fi  ■  gi)' '\ 

\  ^21  (/o  •  go)'  +  ^i2(/i  •  gi)'  ) 


Consequently, 

if  '  g)'i  =  ^ii(/o  ■  50)^  +  ^i2(/i  ■ 

=  d"  ^I2fr)  '  {bxigi  d"  bi2gr))  d"  bi2{{(^2lfl  "h  ^22/’')  '  {^2i91  d“  ^225^’’)) 

=  d-  bi2a'2ib'2i){fi  •  gi)'  -f  (^>iian&i2  +  ^i202i^22)(/^ '  dr)' 

d"(6llU]^2^11  d"  ^12^22^2i)(-^''  '  9l)  d”  (^11^*12^12  d”  ^12®22^22)(/^  ’  9r) 

if  '  g)r  =  ^>2l(/o  •  fl'o)^  d- fe22(/l  • 
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=  ^2l((On//  +  0-l2fr)  •  {Ki91  +  K29r)y  +  ^22((«2l/(  +  <^22/r)  ‘  {Kl9l  +  ^'229r))' 
—  (^21<*ll^ll  "i"  ^22®21^2l)(/'f  '  5/)  (^21<^i1^12  "I"  ^22^21  ^22)(/^  ' 

+  (&21®12^11  ^22<^22^2i)(/’’  '  fi'O  ”1”  (^21<jtl2^12  ^22^*22^22) (/r  '  5^’’) 


Since  both  (/  •  g)'i  and  (/  •  can  be  computed  in  terms  of  (/;  •  gi)\  {ft  ■  gr)',  {fr  •  gi)',  and 
{fr  ■  we  can  compute  the  transformation  of  the  product  in  a  recursive  manner.  If  we 
store  these  intermidiate  results,  the  total  number  of  recursive  calls  to  compute  (/  •  g)'  will 
be  at  most  |/'||5''|.  Because  of  the  additions  that  are  needed  in  the  computation,  the  worst 
case  complexity  can  still  be  exponential.  However,  in  practice,  this  algorithm  works  quite 
well.  As  an  example,  in  Table  3,  we  show  the  time  it  takes  to  compute  the  hybrid  decision 
diagram  for  (E”=o^i2’)  •  (Ej=o2/i2'^)  hybrid  decision  diagrams  for  (Z)r=o®*'2*)  and 


n 

10 

20 

30 

40 

50 

60 

70 

80 

90 

100 

time(sec) 

1.6 

2.0 

2.2 

2.5 

3.0 

3.5 

3.5 

4.5 

5.5 

6.6 

|HDD| 

139 

479 

1019 

1759 

2699 

3839 

5179 

6719 

8459 

10399 

Table  3:  Experimental  results  for  computing  •  (I2j=o2/i2-^) 


Now  that  we  are  able  to  add  and  multiply  functions,  we  can  perform  all  of  the  standard 
logical  operations.  For  example  (“>/)'  =  (1  ~  fY  =  ~  f  and  (/  A  gY  =  (/  •  gY- 


8.  Equations  and  inequalities 

Frequently,  it  is  useful  to  be  able  to  compute  the  set  of  assignments  that  satisfy  fi  ~  /2, 
where  ~  can  be  one  of  =,  /,  <,  <,  >,  or  >.  For  example,  the  following  inequality  is  extremely 
important  for  the  correctness  of  the  radix-4  SRT  floating  point  division  algorithm. 

—2  •  divisor  <  3  •  remainder  <  2  •  divisor 

Both  divisor  and  remainder  in  the  inequality  can  be  regarded  as  arrays  of  boolean  variables. 
In  order  to  verify  the  correctness  of  the  algorithm,  it  is  necessary  to  determine  the  set  of 
assignments  to  these  variables  that  make  the  inequality  true. 

Finding  the  set  of  assignments  that  satisfy  an  inequality  can  be  reduced  to  the  problem 
of  finding  the  set  of  assignments  that  make  a  function  /  positive.  Equations  can  be  handled 
in  a  similar  manner.  A  straightforward  way  of  solving  the  problem  is  to  convert  /  to  an 
MTBDD  and  then  pick  the  terminal  nodes  with  the  correct  sign.  However,  this  does  not 
work  very  well  in  general,  because  some  functions  have  MTBDDs  with  exponential  size  but 
hybrid  BDDs  of  polynomial  size.  For  example,  let  /i  =  and  /2  =  YffLo  ■  Both 

of  these  functions  and  their  difference  have  linear  size  BMDs.  The  BDD  for  the  set  of 
assignments  satisfying  /i  —  /2  >  0  ^^Iso  has  linear  size.  But  the  MTBDD  size  for  /i  —  /2  is 
exponential. 
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We  have  developed  an  algorithm  that  can  substantially  reduce  the  cost  for  computing 
arithmetic  relations  between  certain  functions  represented  by  hybrid  decision  diagrams.  In 
the  process,  we  only  need  to  know  the  sign  of  the  function  values.  Thus,  if  we  find  out  that 
all  of  the  values  in  a  sub-HDD  have  the  same  sign,  we  can  conclude  that  all  assignments 
in  the  sub-HDD  will  have  the  same  value  for  the  relation.  Consequently,  we  don’t  need  to 
continue  to  expand  this  sub-HDD. 

To  obtain  a  good  algorithm  for  this  problem,  it  is  necessary  to  determine  efficiently  if  a 
sub-HDD  has  uniform  sign.  This  can  be  achieved  by  computing  upper  and  lower  bounds  for 
the  sub-HDD.  The  algorithm  given  below  determines  this  information.  If  the  intermediate 
results  are  stored,  the  algorithm  takes  time  linear  in  the  number  of  HDD  nodes. 

bound_values(f ,  upper,  lower) 
begin 

if(f  is  terminal  node) 
upper  =  lower  =  f. value; 

bound_values(left(f) ,  upperl,  lowerl) ; 

bound_values (right (f) ,  upper2,  lower2) ; 

let  {{all,  al2},  {a21,  a22}}  be  the  inverse  matrix  at  node  f; 


upperl 1  = 
upper 12  = 
upper 21  = 
upper22  = 


if  all>0  then  all*upperl  else  all*lowerl; 
if  al2>0  then  al2=f'upper2  else  al2*lower2; 
if  a21>0  then  a21*upperl  else  a21*lowerl; 
if  a22>0  then  a22*upper2  else  a22*lower2; 


lowerll  = 
lowerl2  = 
lower 21  = 
lower22  = 


if  all>0  then  all*lowerl  else  all*upperl; 
if  al2>0  then  al2*lower2  else  al2*upper2; 
if  a21>0  then  a21*lowerl  else  a21*upperl; 
if  a22>0  then  a22*lower2  else  a22*upper2; 


upper  =  max(upperll  +  upperl2,  upper21  +  upper22) ; 
lower  =  minClowerll  +  lowerl2,  lower21  +  lower22) ; 
end 


The  improved  algorithm  for  computing  the  HDD  for  the  set  of  assignments  that  make  the 
function  /  positive  is  given  below.  A  similar  algorithm  is  used  to  find  the  set  of  assignments 
that  make  a  function  zero. 


bdd  greater_than_0(f ) 
begin 

if(f  is  terminal  node) 
if (f. value  >  0) 
return (True) ; 
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else 

return (False) ; 

bound.values (f ,  upper,  lower); 
if (upper  <=  0) 
return(False) ; 
if (lower  >  0) 
return (True) ; 

let  {{all,  al2},  {a21,  a22}}  be  the  inverse  matrix  at  node  f; 
left  =  great er_than_0 (all  *  left(f)  +  al2  *  right(f)); 
right  =  greater_than_0(a21  *  left(f)  +  a22  *  right(f)); 
return (bdd_if_then_else(level (f ) ,  left,  right)); 
end 

This  algorithm  works  extremely  well  for  verification  of  arithmetic  circuits.  The  following 
theorem  guarantees  the  efficiency  of  this  algorithm  for  the  set  of  linear  expressions  when 
the  Hybrid  Decision  Diagrams  are  HMDs.  Most  of  the  formulas  that  occur  during  the 
verification  of  the  SRT  division  algorithm  are  in  this  class.  These  expressions  have  the  form 
/  =  YXzi  ^ifii  where  /,•  =  for  1  <  f  <  m  and  the  Ci’s  are  integer  constants.  We  use 

the  variable  ordering  a;i„,  X2n-,  •  •  •  >  Xmni  •  •  • ,  a;io,  a;2o,  •  •  ■ ,  a^mo-  Because  f\xij=i  —  /U.j=o  =  Ci2-’ 
is  a  constant,  the  BMD  for  /  is  shown  in  Figure  8. 


Figure  8:  BMD  for  YliLi 


Theorem  2  The  complexity  o/greater_than_0  for  f  is  0{vfYfk=i  kfc|)- 
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time(sec) 


A  <  •  -► 


4.0 


3.0 


2.0 


1.0 


0.0 

10  20  30  40  50  60  70  80  90  100 

Figure  9:  time  to  compute  —2  •  divisor  <  3  •  remainder  <  2  •  divisor 

In  the  case  of  linear  inequalities,  all  the  new  BMDs  that  are  generated  have  the  form  of 
c  +  g,  where  c  is  a  constant  and  g  is  an  existing  BMD.  If  we  remember  the  constant  without 
actually  adding  it  to  the  BMDs,  we  are  able  to  avoid  generating  new  BMD  nodes.  After 
introducing  this  technique,  the  complexity  to  compute  greater_than-0(f )  can  be  further 
reduced  to  0{nYj'k=i  kA;!)-  For  the  example  we  considered  at  the  beginning  of  the  section, 
the  relationship  between  the  time  it  takes  to  compute  the  inequality  and  the  number  of  bits 
is  shown  in  the  Figure  9. 

9.  Summary  and  directions  for  future  research 

In  this  paper,  we  have  used  MTBDDs  to  represent  functions  that  map  boolean  vectors 
into  integers.  We  have  also  shown  how  to  represent  large  integer  matrices  concisely  and 
perform  standard  matrices  operations  such  as  scalar  multiplication,  matrix  addition  and 
matrix  multiplication. 

The  Walsh  and  Reed-Muller  transforms  are  given  by  matrices  that  have  simple  recursive 
definition.  Because  of  this,  the  transforms  can  be  computed  efficiently  using  MTBDDs.  In 
fact,  we  are  able  to  find  the  transforms  of  boolean  functions  with  several  hundred  variables. 

We  discuss  the  relationship  between  spectral  transforms  and  binary  moment  diagrams 
and  describe  a  generalization  called  the  hybrid  decision  diagram  which  is  often  much  more 
concise.  We  also  give  an  efficient  implementation  of  arithmetic  operations  on  hybrid  decision 
diagrams. 

Computing  the  BDD  for  the  set  of  variable  assignments  that  satisfy  an  arithmetic  relation 
is  important  for  reasoning  about  arithmetic  circuits.  We  give  an  efficient  algorithm  for  this 
purpose.  Finally,  we  prove  that  for  the  class  of  linear  expressions,  the  time  complexity  of 
our  algorithm  is  linear  in  the  number  of  variables. 


No.  of  bits 
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In  [6],  we  show  how  our  technique  for  computing  the  Walsh  transform  can  be  used  in 
technology  mapping.  Permutation  and  complementation  of  input  variables  does  not  change 
the  sorted  absolute  values  of  the  Walsh  spectrum  of  a  boolean  function.  Thus,  by  comparing 
the  Walsh  spectra  of  two  boolean  functions,  we  obtain  a  necessary  condition  for  determining 
if  one  can  be  changed  to  the  other  by  these  operations. 

The  algorithms  for  performing  arithmetic  operations  and  finding  the  set  of  variable  as¬ 
signments  that  satisfy  an  arithmetic  relation  make  it  possible  to  extend  the  symbolic  model 
checking  algorithms  so  that  they  can  be  used  to  verify  the  properties  of  data  paths  in  addi¬ 
tion  to  controlling  circuitry.  In  a  forthcoming  paper,  we  plan  to  discuss  how  this  technique 
can  be  used  to  verify  an  SRT  algorithm  that  is  similar  to  the  division  circuit  that  is  used  in 
the  Pentium  processor. 

There  are  other  possible  applications  of  the  techniques  discussed  in  this  paper.  MTBDDs 
enable  us  to  represent  and  manipulate  very  large  matrices  efficiently.  Some  potential  appli¬ 
cations  include  image  compression,  numerical  solution  of  partial  differential  equations  and 
computation  of  limit  state  probabilities  for  Markov  Chains.  Since  hybrid  decision  diagrams 
tend  to  be  more  concise  than  multi-terminal  BDDs,  they  may  prove  even  more  useful  for 
this  type  of  application. 
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